WOULD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICA TION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



International Patent Classification 6 : 
CA)GV 3/033, G06K 11/18 



Al 



(II) International Publication Number: WO 99/60468 j 

(43) International Publication Date: 25 November IW (25.1 l.'Wl . 



2\) Inlerniitional Application Number: PCT/SE99/007 IX 

22) International Filing Date: 30 April 1999 (30.04.99) 



30 » Priority Data: 

9801535-7 
60/091.323 
9S03455-6 
60.M05.7NO 



30 April 199S (30.04.98) SE 

30 June I99S (30.06.98) US 

9 October 199S (09.10.9S) SI- 

27 October 199S (27.lO.9S) US 



71 i Applicant {for all designated Slates except ILS): C TECH- 
NOLOGIES AB (SE/SEj: Porskningsbyn Idcon, S-223 70 
Lund (SB). 

~2\ Inventors; and 

7*i Inventors/Applicants (for US only): FA1IRAEUS. Christcr 
ISI- S1-!: Solvegatan 3. S-223 62 Lund (SE). HUGOSSON, 
Ola | SE/SEJ; Sandgatan 14 B. S-223 50 Lund (SE). 
KRICSON. Petter JSE/SE); industi icatan 2 B, S-212 14 
Maimo iSF.). 

,"4. Auent: A WAP A TENT AB; P.O. Bos 5117. S-200 71 Malmo 
• SEi. 



(Kl) Designated Stales: AE, AL, AM. AT. AT i Utility model). All. 

AZ. BA. BB. BG. BR. BY, CA, CM. CN. C'U. CZ. CZ 
(Utility model). DU. DE (Utility model), OK. DK (Utility 
model"), EE. EE (Utility model), ES, FI. I ; l (Utility model). 
GB GD. GE, GH, GM. I1R, MU. ID, IL, IN. IS. JP. Kt. 
KG KP, KR. KZ, LC. LK, LR, LS, LT, LU, LV. MD. M(i. 
MK, MN, MW, MX. NO, NZ, PL. PL RO. RU. SD. SE. 
SG. SI, SK. SK (Utility model), SL, TJ. TM. TR, 'IT. UA. 
UG, US. UZ, VN, YU, /A, ZW, AR1PO patenr (OH, GM. 
KH. LS. MW, SD. SL, SZ. U<}. ZW), Eurasian patent (AM. 
AZ BY. KG, KZ. MD, RU. TJ. TM), European patent (AT, 
BE, CH. CY, DE. DK. ES. FL FR. GB, GK, IE. IT. LU. 
MC. NL, PT. Si:). OAPI patent (BP, BJ. CF, CG, CI. CM. 
CA. GN, GW, ML, MR. NE. SN, TD. TG). 



Published 

With international search report. 

He/ore the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 

In English translation (filed in Swedish). 



.54i Title: INPUT UNIT, METHOD FOR USING THE SAME AND INPUT SYSTEM 



25 1& 




(57) Abstract 



An input unit has a mouse function and at least one inputting function. The input unit comprises image-recording means (S) whicl 
record images. These images are used for providing both the mouse function and the inputting function. The images arc processed .n tin 
inpui unit or in some other unit. 
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TMPITT UNIT , METHOD FOR USING THE SAME AND INPUT SYSTEM 

Field of the Invention 

The present invention relates to an input unit hav- 
ing a mouse function and at least one inputting function, 
which input unit comprises" image-recording means for pro- 
viding the inputting function. The invention also relates 
to a method for providing a mouse function and at least 
one inputting function with the aid of an input unit, as 
well as an input system having a mouse function and at 
least one inputting function. 
F.ackground of the Invention 

Today, personal computers are usually equipped with 
0 a computer mouse, which is used for positioning a cursor 
on the computer screen. The positioning is carried out by 
the user passing the mouse over a surface, the hand move- 
ment thus indicating how the mouse should be positioned. 
The mouse generates positioning signals indicating how 
5 the mouse is being moved and thus how the cursor should 
be moved. For this purpose, the mouse usually has a track 
ball, which turns as a result of friction against the 
surface when the mouse is passed over the same and which 
in this connection drives position sensors which in turn 
0 generate the positioning signals. Normally, the mouse can 
also be used for providing instructions to the computer 
by the intermediary of one or more buttons on which the 
user clicks. However, when the term "mouse function" is 
used below it only refers to the function of positioning 
5 a cursor or the like. : \" 
To input text and images into a'computer a hand-held 
scanner is sometimes used, which images the text or image 
w-hich is to be input with the aid of a light-sensitive 
sensor. The scanner can only image a very limited text/ 
*0 image area at one time. Consequently, in order to record 
one or several words or a whole image, the scanner must 
be passed over the text/image and several sub-images must 
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be recorded. Usually, the scanner has some kind of posi- 
tion sensor which determines how these sub- images should 
be stored in the computer to enable the creation of a 
composite image therefrom. 

It is known to combine a mouse function and an 
inputting function in a casing which is connected with 
a single flex to a computer. 

US 4,906,84 3, for example, shows a combined mouse, 
optical scanner, and digitising pad. In the mouse mode, 
a" track ball is used, which drives two position sensors, 
which generate the positioning signals. In the scanner 
mode, a CCD line sensor as well as the position sensors 
are used for inputting characters or graphical informa- 
tion to the computer. 

US 5,355,146 shows a similar input unit with a com- 
bined mouse function and scanner function, which also 
utilises a track ball and a CCD line sensor. 

EP 0 782 321 shows yet another input unit having a 
mouse function and scanner function. In this case, too, 
a track ball is used for the mouse function but instead 
of the line sensor, use is made of an area sensor which 
is capable of imaging a document in a single step and 
which thus need not be moved across the document. This 
1S said to have the advantage that no software is requir- 
25 ed for correlating image data with position data. 

US 5,633,489 shows a combined mouse and barcode 
reader, where the mouse function is provided by means of 
a track ball and the barcode reader comprises a laser 
diode which generates a laser beam emitted from the 
underside of the mouse and a photo detector which detects 
the varying intensity of the reflected .light . 

All these known input units have a rather complicat- 
ed mechanical design with moving parts and many sensors. 
Moreover, they only provide limited synergies between the 
functions combined in one and the same casing. 
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Summary of the Invention 

It is thus an object of the present invention to 
provide an input unit having a mouse function and at 
least one inputting function as well as a method for 
providing the mouse function and the inputting function 
5 with the aid of the input unit, which input unit and 
which method reduce the above-mentioned deficiencies. 

This object is achieved by an input unit according 
to claim 1, a method according to claim 19, and an input 
system according to claim 24. Preferred embodiments are 
10 stated in claims 2-18 and claims 20-23 respectively. 

An input unit according to the invention thus 
comprises image-recording means for providing said 
inputting function, with the image-recording means also 
being used to provide the mouse function. 
15 Instead of using the image-recording means for only 

one of these functions, according to the present inven- 
tion they are used to provide both the mouse function and 
the inputting function, whereby improved integration of 
these functions is achieved. Furthermore, the track ball 
20 can be omitted and both functions can be based on the 

same sensor technology so that the signals for both func- 
tions can be handled by the same hardware and/or soft- 
ware. Thereby, real integration of the two functions is 
obtained rather than the two simply being brought toge- 
25 ther in the same casing as in the prior art. In addition, 
it becomes possible to provide an input unit without mov- 
ing parts, which is advantageous from the point of view 
of durability and manufacturing. As will be evident 
below, it is also possible to provide an input unit whicr 
30 requires neither special position-determination means no: 
additional aids in the form of a raster or the like. 

In this context, it should be noted that in this 
patent specification the term inputting function refers 
to a function whereby the user can input information to 
35 receiver for storing and processing in the same, unlike 



PCT/SE99/00718 

WO 99/60468 

4 

the mouse function which is used for positioning pur- 
Doses . 

Furthermore, it should be noted that the mouse func- 
tion can be used for positioning a cursor or the like in 

5 a plane or in space. 

More specifically, the input unit is advantageously 
adapted to emit positioning signals for providing the 
mouse function, as well as inputting signals for provid- 
ing said inputting function, the positioning signals as 
10 well as the inputting signals being based on images 

recorded by means of the image-recording means. The posi- 
tioning signals can be used for controlling a cursor on a 
computer screen, while the inputting signals can contain 
information which is to be input to the computer. 
15 The positioning signals and the inputting signals 

can be emitted as electrical signals on leads, as IR sig- 
nals, as radio signals, or in some other suitable way. 
Naturally, the input unit can also emit signals other 
than the positioning signals and the inputting signals, 
20 e.g. instruction signals based on clickings. The receiver- 
of the signals can be a computer or some other input unit 
to which positioning information and/or other information 
is to be input. The input unit is especially suitable for 
use with small portable computers where it is desirable 
25 to have few, but versatile, accessories. 

The image -recording means may comprise a first 
image -recording unit for providing the mouse function and 
a second image -recording unit for providing the inputting 
function. This may be particularly advantageous if diffe- 
30 rent image -recording characteristics are desired for the 
two functions, e.g. if different foci are desired for the 
image -recording. For example, when using the mouse func- 
tion one may wish to be able to move the input, unit 
across a surface in the same way as one would move a tra- 
35 ditional mouse, and when using the inputting function one 
may wish to be able to use the input unit as a camera for 
imaging objects located at a distance from the unit. In 
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this case, the different image -recording units can be 
provided with different lens means with different foci. 
The image-recording units can, for example, be located on 
different sides of the input unit, but have shared hard- 
5 ware and software. 

Alternatively, the image -recording means may com- 
prise an image -recording unit., which is used for providing 
both the mouse function and the inputting function. This 
embodiment is advantageous because it requires fewer com- 
10 ponents in the input unit and only one beam path. 

The image -recording units may comprise any type 
of sensor which can be used for recording an image but 
should preferably be a light-sensitive sensor with a two- 
dimensional sensor surface, a so-called area sensor. 
15 in a less complex embodiment of the input unit, both 

the positioning signals and the inputting signals may 
essentially consist of the actual images recorded by the 
image-recording means. In this case, essentially all pro- 
cessing of the images takes place in the receiver of the 
20 signals, e.g. in a computer. If so, the latter must have 
software for processing the signals in a suitable manner. 
Such software may already be stored in the computer or 
mav, for example, be included in the input unit according 
cc the invention and be transferred to the receiver when 
2 5 the input unit is in use. 

The receiver of the signals from the input unit must 
be capable of determining whether the signals are intend- 
ed as positioning signals or as inputting signals so that 
it will know how to process the signals. For this pur- 
30 pose, the input unit is adapted to output the positioning 
siqnals and the inputting signals in such a way that the 
receiver can identify whether it is receiving positioning 
signals or inputting signals. For example, the input unit 
may use different protocols for the different signals. 
35 Suitably, the input unit should also know whether 

the user wishes to use the mouse function or the input- 
ting function so that it will know how the images record- 
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ed by the image recorder should be processed. For this 
purpose, the input unit preferably comprises switching 
means, e.g. a button, which are adapted to switch the 
input unit between its different functions when acted 

5 upon by the user. 

Preferably, at least for the mouse function, the 
image -recording means are adapted to record a plurality 
of images in such a way that the contents of each image 
overlap the contents of the previous image, if any. This 
10 can be achieved by recording the images with sufficiently 
high frequency in relation to the expected speed of move- 
ment. By virtue of the fact that the images overlap, 
their relative positions are determined and there is no 
need to use special position-determination means. 
15 Once the images have been recorded the subsequent 

processing can take place either in image-processing 
means in the input unit or in the receiver of the sig- 
nals from the input unit. The advantages of processing at 
least the inputting signals in the input unit are that, 
20 in this way, the input unit can be used as a stand-alone 
unit without being connected to an adjacent receiver, 
that information which has been input can be shown 
directly on a display on the input unit so that the user 
can check that the information recorded really is the 
25 information he intended to record, and that the informa- 
tion can be transferred in a more compressed format to 
the receiver. Furthermore, the input unit can be connect- 
ed to any receiver that supports a mouse with no special 
software being required in the receiver for processing 

3 0 the images. 

Thus, the input unit advantageously comprises image - 
processing means used for both the mouse function and the 
inputting function. These image-processing means may com- 
prise a processing unit operating according to different 

35 program modules depending upon which function of the 
input unit is being used. 
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Moreover, for processing the images in the input 
unit, the input unit advantageously comprises means for 
determining the relative position of the images with the 
aid of the partially overlapping contents. The means for 
5 determining the relative position of the images may be 
included in the shared image-processing means and be 
implemented by means of software. 

If the mouse function is used for linear positioning 
only, it is sufficient to determine the relative position 

10 of the images horizontally. However, if it is to be used 
for two-dimensional positioning, the relative position 
must be determined both horizontally and vertically. 

In an advantageous embodiment, the input unit com- 
prises means for generating the positioning signals on 

15 the basis of the relative position of the images. The 

positioning signals can, for example, be composed of one 
or more vectors indicating how the input unit has been 
moved between the recording of two images, or of one or 
more positioning coordinates. The means for generating 

20 the positioning signals can also be included in the 

shared image -processing means and be implemented by means 
of software. 

The input unit is advantageously hand-held so that 
it can be carried everywhere. This technology thus 
25 enables the user to have a personal mouse and input unit 
with stored personal settings and personal inform"- 1 .^ 

In a particularly advantageous embodiment, the input 
unit also comprises a transmitter for wireless connection 
of the input unit to a receiver, which further facili- 
30 tates the use of the input unit. The Bluetooth standard 
can advantageously be used for this purpose. 

Advantageously, the inputting function comprises a 
scanner function so that the input unit can be used for 
recording text and/or images. 
25 The inputting function can also comprise a camera 

function, wherein the image-recording means are utilised 
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for imaging objects located at a distance from the input 
unit . 

The inputting function can also comprise a function 
for inputting handwritten/drawn, i.e. hand-generated 
information. Each of the scanner function, the camera 
function, and the handwriting/drawing function can be the 
only inputting function or one of several inputting June- 
tions . 

The input unit can thus have a plurality of func- 
tions, all of v/hich are based on images which are record- 
ed by' the image-recording means and which are processed 
efficiently by means of shared hardware and software. 

According to a second aspect to the invention, it 
relates to a method for providing a mouse function and 
at least one inputting function with the aid of an input 
unit, comprising the steps of detecting which of said 
functions is desired; recording at least one image with 
the aid of the input unit; and processing said at least 
one image in different ways depending upon which of said 
functions is desired. 

The advantages of the method according to the inven- 
tion are evident from the above description of the input 
unit according to the invention. 

According to a third aspect of the invention, it 
relates to an input system having a mouse function and at 
least one inputting function, comprising image-recording 
means for recording images and image-processing means for 
processing the images recorded by the image- recording 
means for providing the mouse function and said at least 
one inputting function, the image-recording means being 
located in a first casing and the image-processing means 
being located in a second casing. 

Accordingly, the input system comprises the case 
where the image-recording means are located in an input 
35 unit and the image-processing means are located in a com- 
puter or other receiver to which the input unit is con- 
nected and to which it transmits recorded images. Every- 
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thing that has been stated above with respect to the 
image-recording means and the processing of the images 
recorded by the image-recording means also applies to the 
input system. 

Brief Description of the Drawings 

The present invention will now be described in more 
detail by way of an embodiment with reference to. the. 
accompanying drawings, in which 

Fig. 1 schematically shows an embodiment of an input 
unit according to the invention; 

Fig. 2 is a block diagram of the electronic cir- 
cuitry in an embodiment of an input unit according to 
the invention; 

Fig. 3 is a flowchart of the mouse function; 
Fig. 4 is a flowchart of the handwriting/drawing 
function; 

Fig. 5 schematically shows how a surface is imaged 
in connection with the inputting of handwritten' informa- 
tion; 

Fig. 6 shows how the handwritten input can be shown 
0 on a display; 

Fig. 7 is a flowchart of the scanner function; 
Figs 8a- 8c schematically show how text is recorded 
in the scanner mode; and 

Fig. 9 is a flowchart of the camera function. 
Description of a Preferred Embodiment 
5 The following is a description of an embodiment of 

an input unit according to the invention having a mouse 
function, a scanner function, a camera function, as well 
as a function for inputting handwritten/drawn informa- 
tion . 

Design of the Unit 
0 Fig. 1 shows the design of the input unit accord- 

ing to this embodiment. The unit has a casing 1 having 
approximately the same shape as a conventional high- 
lighter pen. One short side of the casing has a window 2, 
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by the intermediary of which images are recorded for the 
various image-based functions of the input unit. 

The casing 1 essentially contains an optics part 3, 
an electronic circuitry part 4, and a power supply 5. 
5 The optics part 3 comprises a light-emitting diode 

6, a lens system 7, and an image -recording means in the 
form. of a light-sensitive sensor .8, which constitutes the. 
interface with the electronic circuitry part 4 . 

The task of the LED 6 is to illuminate a surface 
10 which is currently located under the window. A diffuser 9 
is mounted in front of the LED 6 for diffusing the light. 

The lens system 7 has the task of projecting an 
image of the surface located under the window 2 on the 
light-sensitive sensor 8 as accurately as possible. The 
15 lens system is displaceable between two positions, the 
second of which is indicated by dashed lines. The first: 
position is used when images are to be recorded of a 
surface located directly below the window of the input 
unit and is primarily intended for the mouse function, 
20 the scanner function, and the handwriting/drawing func- 
tion. The second position is used when images are to be 
recorded of objects located at a distance from the input 
unit and is primarily intended for the camera function, 
but can also be used for the other functions. 
25 m this example, the light-sensitive sensor 8 com- 

prises a two-dimensional, square CCD unit (CCD = charge 
coupled device) with a built-in A/D converter. Such sen- 
sors are commercially available. The sensor 8 is mounted 
at a small angle to the window 2 and on its own circuit 

3 0 board 11. 

The power supply to the input unit is obtained from 
a battery 12 which is mounted in a separate compartment 
13 in the casing. 

The block diagram in Fig. 2 schematically shows the 
35 electronic circuitry part 4. This comprises a processor 
20, which by the intermediary of a bus 21 is connected 
to a ROM 22, in which the programs of the processor are 
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scored, to a read/write memory 23, which constitutes the 
working memory of the processor and in which the images 
from the sensor are stored, to a control logic unit 24, 
as well as to the sensor 8 and the LED 6. The processor 
5 20, the bus 21, the memories 22 and 23, the control logic 
unit 24, as well as associated software together consti- 
tute image-processing ( means. 

The control logic unit 24 is in turn connected to 
a number of peripheral units, comprising a display 25, 
0 which is mounted in the casing, a radio transceiver 26 
for transferring information to/from an external compu- 
ter, buttons 27, by means of which the user can control 
the input unit and specifically adjust the input unit 
between the mouse function, the scanner function, the 
5 camera function, and the handwriting/drawing function, 
buttons 27' corresponding to the clicking buttons on a 
traditional mouse, a tracer LED 28 which emits a light 
beam, making it easier for the user to know which infor- 
mation he is inputting, as well as an indicator 29, e.g. 
0 an LED, indicating when the pen is ready to be used. Con- 
trol signals to the memories, the sensor 8, and the peri- 
pheral units are generated in the control logic unit 24. 
The control logic also handles generation and prioritisa- 
tion of interrupts to the processor. The buttons 27 and 
5 27', the radio transceiver 26, the display 25, the tracer 
LED 28, and the LED 6 are accessed by the processor writ- 
ing and reading in a register in the control logic unit 
24. The buttons 27 and 27' generate interrupts to the 
processor 2 0 when they are activated . 
Operation of the U nit 
0 The various functions of the input unit, viz. the 

mouse function, the scanner function, the handwriting/ 
drawing function, and the camera function, will now be 
described. All of these functions are based on images 
which are recorded with the aid of the sensor 8. When the 
5 first three functions are used, a plurality of images are 
recorded in such a way that the contents of each image 
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partially overlap the contents of the previous image, if 
any. As the images are being recorded, the relative posi- 
tion of the images is determined, i.e. the position which 
affords the best possible correspondence between their 
5 contents. Subsequently, the processing is carried out 
depending upon the function selected by the user. When 
recording the images, the input unit can be passed over a 
surface with the window 2 in contact with the same, or be 
held at a small or at a larger distance from the surface 
10 depending upon the setting of the lens system. The sur- 
face need not be plane. For example, it could be a sheet 
of paper with text on it, a wall covered with patterned 
wallpaper, or a bowl of sweets. What is important is that 
images with varying contents can be recorded so that the 
15 relative positions of the images can be determined with 
the aid of the contents of the images. 
The Mouse Function 

First, suppose that the user wishes to use the input 
unit as a mouse.- In this case, he sets the unit to the 
mouse function with the aid of the buttons 27, whereupon 
20 the input unit starts operating in the mouse mode, and 
logs into the computer for which the input unit is to 
operate as a mouse. Subsequently, the user directs the 
window 2 of the input unit at a patterned surface, e.g. 
a mouse pad. He presses one of the buttons 27 to activate 
25 the input unit, whereupon the processor 20 commands the 
LED 6 to begin generating strobe pulses at a predeter- 
mined frequency, suitably at lease 50 Hz. Subsequently, 
the user passes the input unit over the surface in the 
same way as if it were a traditional mouse, whereupon 
30 images with partially overlapping contents are recorded 
by the sensor 8 and are stored in the read/write memory 
23. The images are stored as images, i.e. with the aid of 
a plurality of pixels, each having a grey scale value in 
a range from white to black. 
35 The flowchart in Fig. 3 shows in more detail how the 

input unit operates when the mouse function is used. In 
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S r e p 300, a starting image is recorded. In step 301, the 
next image is recorded. The contents of this image par- 
tially overlap the contents of the previous image. 

As soon as an image has been recorded in step 301, 
5 the process begins of determining how it overlaps the 
previous image both vertically and horizontally, step 
302, i.e.. in which relative position the. best match is 
obtained between the contents of the images. For this 
purpose, every possible overlap position between the 
10 images is examined, at the pixel level, and an overlap 
measurement is determined as follows: 

1) For each overlapping pixel position, the grey 
scale values of the two relevant pixels are added up if 
the latter are not white. Such a pixel position in which 

15 none of the pixels are white is designated a plus 
position. 

2) The grey scale sums for all the plus positions 
are added up. 

3) The neighbours of each pixel position are exa- 
20 mined. If an overlapping pixel position is not a neigh- 
bour of a plus position and consists of a pixel which is 
white and a pixel position which is not white, the grey 
scale value of the non-white pixel is subtracted, pos- , 
sibly multiplied by a constant, from the sum in point 2) . 

25 4) The overlap position providing the highest 

overlap measurement as stated above is selected. 

Our Swedish patent application No. 9704924-1 and 
the corresponding U.S. application No. 024,641 describe 
an alternative way of matching the images in order to 
30 find the best overlap position. The content of these 
applications is herewith incorporated., by reference. 

As soon as the best overlap position between the 
current image and the previous image has been determined,, 
the previous image is discarded, whereupon the current 
35 image becomes the previous image in relation to the next 
image recorded. 
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By determining the relative position of the 
images a movement vector is obtained, which indicates how 
far and in which direction the input unit has been moved 
between the recording of the two images. Subsequently, a 
5 positioning signal, which includes this movement vector, 
is transmitted, step 303, by the radio transceiver 26 to 
the computer for which., the input unit is operating as a 
mouse. The computer uses the movement vector for posi- 
tioning the cursor on its screen. Subsequently, the flow 
10 returns to step 301. In order to increase the speed, the 
steps can partly be carried out in parallel, e.g. by 
starting the recording of the next image while the rela- 
tive position of the current and the previous image is 
being determined. 

In the mouse mode, the buttons 27' can be used as 
clicking buttons for inputting instructions to the com- 
puter . 

The Handwriting and Draw ing Function 

Next, suppose that the user wishes to input hand- 
written text to his computer. In this case, with the aid 
2 0 of the buttons 27, he sets the input unit to the hand- 
writing function, whereupon the input unit starts to ope- 
rate in the handwriting mode. When the user subsequently 
activates the input unit, the processor 20 commands the 
LED 6 to begin generating strobe pulses at the predeter- 
25 mined frequency. Subsequently, the user "writes" the text 
he wishes to input with the input unit directed at the 
selected surface, whereupon the sensor 8 records images 
with partially overlapping contents and stores them in 
the read/write memory 23. The tracer LED 28 successively. 
30 indicates the path of movement on the surface by means of 
a luminous spot to give the user an idea of the movement. 
The text is input one character at a time. Between each 
character, the user indicates that an information unit 
has been input, for example by releasing the activating 
3 5 button 27 for a short time or by not moving the input 
unit for a short time. 
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Fig. 4 illustrates in more detail how the inpuc unit 
operates in the handwriting and drawing mode. The first 
three steps correspond to those carried out in the mouse 
mode. When the input unit is activated, a starting image 
is recorded, step 400. The next image, whose contents 
overlap the previous image, is recorded, step 401, and 
their relative position. is. determined, step 402, with the 
aid of the overlapping contents, whereby a movement vec- 
tor is obtained. 

Subsequently, the processor 20 determines whether 
the inputting of an information unit is complete or not, 
step 403. If not, the flow returns to step 401 and the 
next image is recorded. If the inputting is complete, the 
processor 20 reads the movement vectors determined for 
the information unit in question to ah ICR module which 
identifies which character the movement vectors repre- 
sent, step 404. Subsequently, the identified character is 
stored in character-coded format in the memory, step 405, 
and the input unit indicates that it is ready to input a 
0 new information unit, step 4 06. 

The inputted and identified character is preferably 
transferred to a computer in character-coded format by 
the intermediary of the radio transmitter 2 6 and is shown 
directly on the computer screen. If the input un±z is 
5 used as a stand-alone unit, the character can be shown on 
the display 25 instead. 

Fig. 5 schematically shows how images with overlap- 
ping contents are recorded when the input unit is moved 
in a path of movement forming the letter "R" . For the 
0 sake of simplicity, the contents of the images are not 
shown in Fig. 5. 

If, instead, the user indicates that the drawing 
function is to be used,, only steps 400-403 are imple- 
mented. Fig. 6 shows how an inputted letter R can be 
5 reproduced on the display of the input unit or the com- 
puter on the basis of the relative positions of the 
images in Fig. 5 determined by the input unit when the 
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drawing function is used. In this case, a "drawn image" 
of the recorded character is shown with the aid of the 
movement vectors, not an interpreted character. Obvious- 
ly, arbitrary drawn figures and characters can be input 
5 to the input unit or a computer in this manner. 
Thp Scanner Function 

Now, suppose that the user wishes to use. the input 
unit for recording predefined text on an information 
carrier, e.g. a sheet of paper, a newspaper, or a book, 
in this case, he sets the input unit to the scanner func- 
10 tion with the aid of the buttons 27, whereupon the input 
unit starts operating in the scanner mode. 

Subsequently, he directs the input unit at the sheet 
of paper with the text in the location where he wishes to 
begin recording text, activates the input unit with the 
15 aid of the buttons 27, and passes it over the text which 
is to be recorded, following the text in the same manner 
as when one reads the text. The tracer LED 28 emits a 
light beam which makes it easier to follow the lines. 
When the user activates the input unit, the processor 20 
20 commands the LED 6 to record images in the same way as 

described above with respect to the mouse function. When 
the user has passed the input unit over the selected text 
cr has come to the end of a line of characters, he lifts 
the unit off the sheet of paper and releases the activat- 
25 ing button, whereupon the processor 20 turns off the LED 
6 . 

The flowchart in Fig. 7 illustrates in more detail 
how the input unit operates in this mode. In step 700, 
a starting image is recorded. In step 701, a new image 

30 is recorded whose contents overlap that of the previous 
image. In step 702, the best overlap position for the 
current image and the previous image is determined in the 
same way as described above with respect to the mouse 
function. In this position, the images are put together 

35 into a whole composite image, step 703. In step 704, the 
input unit detects whether the inputting of characters is 
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complete. If not, the flow returns to step 701. If the 
user has released the activating button, indicating that 
the inputting is complete, the whole composite image is 
fed as an input signal to an OCR software which identi- 
5 fies and interprets the characters in the image, step 
705. The identified and interpreted characters are 
obtained in a predetermined character-coded ..format , e.g. 
ASCII code, as output signals from the OCR software. They 
are stored in the read/write memory in a memory area for 
10 interpreted characters. When the character identification 
and storing in character-coded format are finished, the 
processor activates the indicator 29 to inform the user 
that it is ready to record a new character sequence, step 
706 . 

15 The interpreted characters can be transferred to a 

computer or other receiver in character-coded format with 
the aid of the radio transceiver 26. 

The above steps are thus carried out by the proces- 
sor 20 with the aid of the associated units and suitable 
20 software. Such software can be created by the skilled 
person with the aid of the above instructions if it is 
not commercially available. 

Figs 8a-8c illustrate how the input unit operates 
when the character sequence "Flygande backasiner" is 
2 5 recorded. Fig. 8a shows the text on a sheet of paper. 

Fig. 8b shows the images which are being recorded • with 
the aid of the sensor. As can be seen from this Figure, 
the contents of the images partially overlap. For exam- 
ple, the letter 1 appears completely in image No. 1 and 
30 partially in image No. 2. The degree of overlapping 

depends on the traction speed, i.e. the speed with which 
the user passes the input unit over the text in relation 
to the frequency with which the contents of the .sensor 8 
are read out. Fig. 8c shows what the whole composite 
35 image looks like. It should be noted that the image is 
still stored in the form of pixels. When the method has 
been carried out, the text "Flygande backasiner" is stor- 
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ed in the read/write memory 2 3 of the input unit as ASCII 
code . 

Thp Camera Function 

Next, assume that the user wishes to record an image 
of an object located at a distance from the input unit. 
The "object" could, for example, be three-dimensional or 
it could be an image in a book. In this case, the user 
sets the input unit to the camera function with the aid 
of the buttons 27, whereupon the input unit begins to 
operate in the camera mode and the position of the lens 
system 7 changes to a position suitable for recording 
images located at a distance from the input unit. Subse- 
quently, the user activates the input unit, whereupon the 
processor begins to read images from the sensor 8. The 
read images can be shown either on the display 25 of the 
15 input unit or on a computer to which the input unit is 

connected and to which the images are transferred as they 
are recorded by the intermediary of the radio transceiver 
26. When the user is satisfied with the appearance of 
the image, he presses one of the buttons 27, which then 
records an image of the object. When the image of the 
object has been recorded, the user can command the input 
unit to show the recorded image on the display 25 or to 
transfer the image to the computer by the intermediary of 
the radio transceiver 26. 
25 The flowchart in Fig. 9 illustrates how the input 

unit is adapted to operate in the camera mode. In step 
901, the extent of the image is indicated on the display 
25 of the input unit. When the user is satisfied with the 
appearance of the image, he presses the button 27, 
30 whereupon the image is frozen and recorded in a buffer 

memory in step 902. The image is recorded with the aid of 
a plurality of pixels, which can either have grey scale 
values from white to black or have colour values. The 
user can then choose whether or not he wishes to keep the 
35 current image. If the user decides to keep the image, the 
process continues along the solid line to step 903, in 
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which the image is stored in the memory 23. When the 
image has been stored, the unit indicates, in step 904, 
that it is ready to record a new image. If the user does 
not wish to keep the image, the process continues, from 
5 step 902, along the dashed line back to step 901 in order 
for a new image to be recorded. 
Alternative Embodiments 

The above embodiment is described by way of example 
only. An input unit according to the invention need not 
comprise all of the functions listed above. It is pos- 
10 sible to combine the mouse function with one or more of 
the scanner function, the camera function, the handwrit- 
ing function, or other inputting functions. 

In the embodiment described above, all processing of 
recorded information takes place in the input unit. This 
15 is not essential. All of the above measures except for 
the actual image-recording can be carried out with the 
aid of image -processing means in an external computer 
or in some other external unit to which the images are 
transferred . 

20 In the embodiment described above, the recording of 

images is carried out by means of a single light-sensi- 
tive sensor. However, it is also possible to arrange a 
second light-sensitive sensor, for instance, in the other 
end of the casing. In this case, it is possible to use 
25 one end with the first sensor for the mouse functicr 
the other end with the second' sensor for one of the 
inputting functions . 

It is not completely essential for the images to be 
recorded with overlapping contents in the mouse mode, the 
3 0 handwriting mode and the drawing mode. In these modes, a 
special substrate with position indications can be used 
instead. For example, the positions can be written as 
coordinates, which are read and interpreted for providing 
positioning signals for a cursor or movement indications 
3 5 enabling the reproduction of a drawn image or a drawn 
character. However, this has the drawback of requiring 
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a special substrate as well as software for interpreting 
the position indications. 
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CLAIMS 



1. An input unit having a mouse function and at 

5 least one inputting function, comprising image-recording 
means (8) for providing said inputting function, 

characterised in that the image- recording 
means (8) are also used for providing the mouse function. 

2. An input unit according to claim 1, wherein the 
10 input unit is adapted to emit positioning signals for 

providing the mouse function, and inputting signals for 
providing said inputting function, both the positioning 
signals and the inputting signals being based upon images 
recorded with the aid of said image - recording means (8) . 
15 3. An input unit according to claim 1 or 2 , wherein 

the image -recording means (8) comprise a first image- 
recording unit for providing the mouse function and a 
second image- recording unit for providing the inputting 
function . 

20 4 . An input unit according to claim 1 or 2 , wherein 

the image -recording means (8) comprise an image-recording 
unit which is used for providing both the mouse function 
and the inputting function. 

5. An input unit according to any one of the preced- 
25 ing claims, wherein the image-recording means comprise at 

least one area sensor. 

6. An input unit according to any one of claims 2-5, 
wherein both the positioning signals and the inputting 
signals are essentially composed of said images. 

30 7 . An input unit according to any one of claims 2-6, 

wherein the input unit is adapted to output the position- 
ing signals and the inputting signals in a way that 
enables a receiver to identify whether it is receiving 
the positioning signals or the inputting signals. 

35 8. An input unit according to any one of the pre- 

ceding claims, further comprising switching means (27) , 
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which, when acted upon by a user, are adapted to switch 
the input unit between its different functions. 

9. An input unit according to any one of the pre- 
ceding claims, wherein the image -recording means (8), at 

5 least with respect to the mouse function, are adapted to 
record. a plurality of images in such a way that the con- 
tent of each image overlaps the content of the previous 
image . 

10. An input unit according to any one of the pre- 
10 ceding claims, further comprising image -processing means 

(20-24) which are used for both the mouse function and 
the inputting function. 

11. An input unit according to claim 9 or 10, fur- 
ther comprising means (20-24) for determining the rela- 

15 tive position of the images with the aid of the partiallv 
overlapping contents. 

12. An input unit according to claim 11, wherein the 
means (20-24) for determining the relative position of 
the images are adapted to determine the relative position 

20 of the images horizontally as well as vertically. 

13. An input unit according 10 claim 11 or 12, fur- 
ther comprising means (20-24) for generating the posi- 
tioning signals on the basis of the relative position of 
the images. 

25 14. An input unit according no any one of the pre- 

ceding claims, which input unit is hand-held. 

15. An input unit according to any one of the pre- 
ceding claims, further comprising a transmitter (26) for 
wireless connection of the input unit to a receiver. 

30 16. An input unit according to any one of the pre- 

ceding claims, wherein said at least one inputting func- 
tion comprises a scanner function. 

17. An input unit according to any one of the pre- 
ceding claims, wherein said inputting function comprises 

35 a camera function for imaging objects located at a dis- 
tance from the input unit. 
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18. An input unit according to any one of the pre- 
ceding claims, wherein said inputting function comprises 
a function for inputting handwritten/drawn information. 

19. A method for providing a mouse function and at 
5 least one inputting function with the aid of an input 

unit, comprising the steps of 

detecting which of said functions is desired; 

recording at least one image with the aid of the 
input unit; and 

10 processing said at least one image in different ways 

depending upon which of said functions is desired. 

20.. A method according to claim 19, which, when the 
mouse function is desired, further comprises the seeps oi 
recording at least two images with partially over- 
15 lapping contents; determining the relative position of 

the images both horizontally and vertically; determining 
a positioning signal on the basis of the relative posi- 
tion of the images; and using the positioning signal for 
controlling a cursor on a computer screen. 
20 21. A method according to claim 19 or 20, in which 

the inputting function is a character- inputting function 
and which, when the character- inputting function is 
desired, further comprises the steps of 

recording a plurality of images with partially over 
25 lapping contents, which images together image the charac 
ters with are to be input; putting the images together 
both horizontally and vertically into a composite image; 
identifying characters in the composite image; interpret 
ing the identified characters; and storing the character 
30 in character-coded format. 

22. A method according to any one of claims 19-21, 
in which the inputting function is a function for input- 
ting handwritten/drawn information and which, when the 
handwriting/drawing function is desired, further com- 
35 prises the steps of 

recording a plurality of images with partially over 
lapping contents; determining the relative position of 
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the images both horizontally and vertically; and deter- 
mining the movement of the input unit on the basis of the 
relative position of the images. 

23. A method according to claim 22, further compris- 
5 ing the step of interpreting which character the movement 

of the. input unit represents and storing this character 
in character-coded format. 

24. An input system having a mouse function and at 
least one inputting function, comprising image -recording 

10 means (8) for recording images and image -processing means 
(20-24) for processing the images recorded by the image- 
recording means for providing the mouse function and said 
at least one inputting function, the image -recording 
means being located in a first casing and the image-pro- 

15 cessing means being located in a second casing. 
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